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(54) Display optimization for night vision enhancement systems 

based upon the horizontal dimension of the field of view 
of the infrared sensor (11) such that the display aspect 
ratio decreases as the horizontal field of view narrows. 



(57) Night vision apparatus (11. 21. 23) including an 
infrared night vision sensor.(l 1) having a selected field 
of view and a display panel (23) positioned for display- 
ing an image detected by the sensor (11), the display 
panel (23) having a display aspect ratio optimized 
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Description 

BACKGROUND OF THE INVFNTION 

1. Field of the Invention 

The subject invention relates to night vision systems and. more particularly, to a method and apparatus for optimiz- 
ing display size and performance in such systems. 

2. Description of Related Art 

Night vision systems have recently been designed for use in connection with passenger vehicles and marine ves- 
sels. Such systems are disclosed, for example, in US. patent applications Serial Nos. 08/226,728, filed April 12 1994 
(Atty. Dkt. No. PD-94072) and the continuation-in-part thereof (Atty. DM. No. PD-94058). entitled "LOW COST NIGHT 
VISION ENHANCEMENT SYSTEM FOR MOBILE LAW ENFORCEMENT APPLICATIONS" and "LOW COST NIGHT 
VISION SYSTEM FOR MOBILE LAW ENFORCEMENT AND MARINE APPLICATIONS." the disclosure of such appli- 
cations being incorporated by reference herein. Such systems employ an externally-mounted night vision sensor (infra- 
red camera) and a display, which is typically mounted within the vehicle or marine vessel for displaying the external 
scene to the operator of the vehicle or vessel. 

Prior to the subject invention, vehicles modified for night vision enhancement have utilized a standard 4 3 aspect 
ratio display, regardless of the sensor (camera) field of view. Such a fixed field of view has several drawbacks. In gen- 
eral, the display provides excess information which may confuse the driver. Depth perception may be skewed with the 
result that the driver cannot judge distances, for example, the distance to a vehicle being followed. Such problems are 
particularly acute in applications where the system magnification is less than 1 , a condition which is desirable to reduce 
display size to the size required to fit typical automobile and other applications. 

OBJECTS AND SUMMARY OF THE INVENTION 

Accordingly, il is an object of the invention to improve night vision systems; 
It is another object of the invention to improve displays used in conjunction with night vision systems; 
It is another object of the invention to provide a night vision system display with improved depth perception; and 
It is another object of the invention to provide a night vision system display with improved information corivevina 
capabilities. 7 s 

According to the invention, a night vision system display is provided wherein the display and sensor field of views 
are optimized for night vision enhancement. A relationship is established according to the invention between the 
selected sensor field of view and the display aspect ratio implemented in response to that selection for a particular loca- 
tion of the sensor on the vehicle. According to this relationship, the display aspect ratio decreases as the selected field 
of view narrows so as to provide only as much information as the operator or driver normally sees out of the windshield 
with the naked eye. Thus, the vertical field of view of the display subtended at the driver's eye is selected to present only 
useful information to the driver, and the road area directly in front of the vehicle, for example, is eliminated from the field 
of view, since it provides no useful information and. in fact, can distract the eye due to the high rate of motion. Depth 
perception is improved, since excess vertical information in the display, which distorts the driver's depth perception, is 
also eliminated. The amount of time required by the driver to assimilate the information provided in the display is also 
reduced, further improving assimilation of the display by the driver. 

BRIEF DESCRIPTION OF THF nRAWlKtfVQ 

The objects and features of the present invention, which are believed to be novel, are set forth with particularity in 
the appended claims. The present invention, both as to its organization and manner of operation, together with further 
objects and advantages, may best be understood by reference to the following description, taken in connection with the 
accompanying drawings. 

FIG. 1 is a schematic perspective view illustrating a night vision enhancement system wherein the preferred 
embodiment finds application; 

FIG. 2 is a schematic diagram illustrating an optical system according to the preferred embodiment; and 
FIG. 3 is a perspective view illustrating an optimized display panel according to the preferred embodiment. 
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DFTAIl Fn DESCRIPTION OF THE PREFERRED EM BODIMENTS 

The following description is provided to enable any person skilled in the art to make and use the invention and sets 
forth the best modes contemplated by the inventor of carrying out his invention. Various modifications, however, will 
s remain readily apparent to those skilled in the art. since the generic principles of the present invention have been 
defined herein specifically to provide readily manufacturable and implemented commercial embodiments. 

FIG. 1 is a schematic diagram illustrating an illustrative installation of a low cost night vision enhancement system 
in a public safety vehicle (shown in phantom). The system 1000 includes a night vision camera 1 mounted in a pointing 
mechanism 500 on top of a public safety vehicle 1010 (shown in phantom). The night vision camera 1 and the pointing 
io mechanism 500 are secured to the top of the vehicle 1010 by suitable mounting hardware 1012 (not shown). 

As further shown in FIG. 1 . the night vision camera 1 is connected to a display unit which, in the illustrative embod- 
iment may implemented as a "Datavision" head-up display (HUD) available from Hughes Aircraft Company. The Data- 
vision HUD includes a projector 587, a combiner 1030. display electronics 1040 located in the trunk, and data harness 
and power harness cables 1038. 1039. The combiner 1030 is mounted on the windshield 1032 (shown in phantom) of 
,s the vehicle 1010 for displaying a real image from the projector 587. The cables 1038. 1039 are shielded and are stowed 

in suitable mounting brackets. n **n\ 
The video display is not limited to a Datavision HUD. Alternatively, an active matrix liquid crystal display (LCD) 
mounted on the dashboard of the vehicle can be used to display the real image from the camera. Active matrix LCDs 
are available from Citizen. Sharp, and Toshiba, to name a few. 

20 Instead of displaying a real image, the video/display can display a virtual image. The virtual image can be displayed 
by "Virtual Image Glasses" available from Virtual Vision in Redmond. Washington. The Virtual Image Glasses project 
a TV-like wide screen image in front of the bumper of the vehicle. An officer wears the Glasses to view the scene 
ahead. Data is transmitted either through hard-wired connections or wireless (e.g.. spread spectrum) transmission from 
the camera to the Glasses. Instead of the Glasses, a helmet-mounted visor can be used to project the TV-like, wide 

25 screen image in front the bumper of the vehicle. 

Alternatively, a virtual image can be displayed directly on the vehicle windshield by the virtual display disclosed and 
claimed in European Patent Application Mo. EP-A-0596729. entitled VIRTUAL IMAGE INSTRUMENT PANEL DISPLAY 
and assigned to the assignee of the present invention. This system, which includes mirrors and an active matrix LCD - 
as a source, can be installed at the vehicle manufacturer, or it can be installed as an aftermarket add-on. 

so The system 1000 is controlled by a remote control unit 566 mounted inside the vehicle 1010. In the preferred 
embodiment, the remote control unit 566 is implemented with a joystick 568 and a plurality of switches 572. The camera 
1 remote control 566 and the projection unit are interconnected by the data harness cable 1038 and a power harness 
cable 1039 to display electronics 1040 located in the trunk of the vehicle 1010. Further details of the vision enhance- 
ment system 2 may be had by reference to the aforementioned U.S. patent applications, herein incorporated by refer- 

35 ence. ., _j . 

FIG 2 schematically illustrates an optical system 13 employing an infrared sensor 11. such as camera 1 used in 
the night vision enhancement system of FIG. 1 . The optical system 1 3 focuses equally-spaced points 15 along a road- 
way 17 onto a focal plane array 19. As disclosed in the afore-mentioned patent applications, the focal plane array 19 
may be an array of uncooled detectors from which an image is ultimately supplied via suitable cables 21 to adisplay 23. 
40 The optical system 13 of FIG. 2 is a wide-angle optical system, i.e.. one that includes both near and far field points 
out in front of the vehicle 1010. In such a system, equally-spaced points in object space are nonlinearly distributed on 
the focal plane array 19. This nonlinear distribution of chief optical rays creates a misjudgment of distance in the driver s 
mind Analyzing the system of FIG. 2. one sees that, as the sensor field of view narrows in the horizontal dimension, 
the display aspect ratio must decrease to present the same amount of vertical information to the driver (i.e.. a constant 
45 vertical field angle). Thus, in a series of photographs of the same vehicle with varying lens angles, judging how far away 
the vehicle is becomes progressively more difficult as the lens angle becomes wider and wider. There is so much extra- 
neous information in the scene that the observer loses the ability to relate the displayed image to the real world. In addi- 
tion although the size of the vehicle becomes progressively smaller as the lens angle widens, the driver sees basically 
the same relative "distance" in each view. The foregoing assumes the size of a vehicle is relatively known to any driver. 

The foregoing analysis demonstrates the inherent relationship between sensor and display fields of view. This rela- 
tionship is quantified empirically in the following table, where "HFOV indicates horizontal field of view: 
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TABLE I 
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SENSOR HFOV 
(DEGREES) 


OPTIMUM DISPLAY 

ASPECT RATIO 
(HORIZONTAL TO 
VERTICAL) 


58 


5:2 


33 


1 4:2 
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5:3 


16 
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angular subtense of feature in object space 

Angular subtense of feature as viewed on display at the driver's eye position 
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A = linear dimension of displayed feature, inches 
B » distance of eye to display, inches 
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front of the driver, in place of the normal automobile instrument panel cluster, although this is by no means the only pos- 
sible location for the display 23. 

The above teachings are thought to apply to all forms of displays possible in a vehicle Flat panels, CRTs, projected 
or direct view, may be implemented in this fashion, regardless of display location in the vehicle. Any empirically-derived 

5 relationship between aspect ratio and sensor or camera field of view (if the camera is visible) will change to some 
degree as the sensor or camera perspective with respect to the driving "scene" in front of the vehicle changes A gen- 
eral formula has not been derived to date, though one could readily be derived geometrically with applied trigonometry. 
The important consideration in the selection of display aspect ratio (in this case 3:1) is to avoid overwhelming the driver 
with extraneous information in the vertical field. Therefore, the wider the horizontal field of view of the sensor is. the nar- 

io rower the display vertical dimension becomes. 

A 9-degree vertical field of view is optimal in the preferred embodiment, as determined through empirical testing. 
In preferred installation, a particular objective was to reduce the amount of time the drivers eyes were off the view 
through the windshield and on the displayed image. 

Those skilled in the art will appreciate that various adaptations and modif cations of the just-described preferred 

>s embodiment can be configured without departing from the scope and spirit of the invention. Therefore, it is to be under- 
stood that, within the scope of the appended claims, the invention may be practiced other than as specifically described 
herein. 
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Claims 

1. A method of optimizing the scene presented to a viewer by a system employing a sensor (11) including a wide 
angle optical system (1 3) and a visual display (1 9) comprising the steps of : 

arranging said sensor (1 1 ) to have a field of view of a selected horizontal dimension; and 
selecting a display aspect ratio for said display (13) based on said horizontal dimension. 

2 The method of Claim 1 wherein said sensor (1.11) is mounted above a windshield ((1032) and said display aspect 
ratio is selected according to a relationship whereby said display aspect ratio decreases as said honzontal dimen- 
sion narrows so as to provide only as much information as a viewer sees out of the windshield (1032) with the 
naked eye (24). 

3. The method of Claim 2 further including the step of selecting the vertical field of view of said sensor (1 1) to be 9 
degrees. 
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The method of Claim 3 further including the step of selecting the horizontal field of view of said sensor (1 1) to be 
27 degrees. 

5. The method of Claim 4 further including the step of selecting the mean distance (22) from the display (23) to the 
viewer s eye (24) to be 30 inches, the system image magnification to be .5:1 , and the display aspect ratio to be 3:1 

6. The method of Claim 2 further including the step of selecting the display aspect ratio in accordance with the follow- 
ing table, where HFOV indicates horizontal field of view: 
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SENSOR HFOV 
(DEGREES) 


SELECTED DIS- 
PLAY ASPECT 
RATIO (HORIZON- 
TAL TO VERTICAL) 


58 


5:2 


33 


4:2 


27 


5:3 


16 


4:3 
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(57) Night vision apparatus (11,21, 23) including an 
infrared night vision sensor (11) having a selected field 
of view and a display panel (23) positioned for display- 
ing an image detected by the sensor (11), the display 
panel (23) having a display aspect ratio optimized 
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based upon the horizontal dimension of the field of view 
of the infrared sensor (1 1) such that the display aspect 
ratio decreases as the horizontal field of view narrows. 
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